NAS  A/CR-2000-2 10124 
ICASE  Report  No.  2000-25 


Trust-region  Proper  Orthogonal  Decomposition  for 
Flow  Control 


E.  Arian 

Ohio  University,  Athens,  Ohio 

M.  Fahl  and  E.  W.  Sachs 
Universitat  Trier,  Trier,  Germany 


Institute  for  Computer  Applications  in  Science  and  Engineering 
NASA  Langley  Research  Center 
Hampton,  VA 


Operated  by  Universities  Space  Research  Association 


National  Aeronautics  and 
Space  Administration 

Langley  Research  Center 
Hampton,  Virginia  23681-2199 


Prepared  for  Langley  Research  Center 
under  Contract  NAS  1-97046 


May  2000 


DISTRIBUTION  STATEMENT  A  j 

Approved  for  Public  Release  ! 
Distribution  Unlimited 


20000518  044 


TRUST- REGION  PROPER  ORTHOGONAL  DECOMPOSITION  FOR  FLOW  CONTROL 

E.  ARIAN*,  M.  FAHLt,  AND  E.W.  SACHS* 


Abstract.  The  proper  orthogonal  decomposition  (POD)  is  a  model  reduction  technique  for  the  simula¬ 
tion  of  physical  processes  governed  by  partial  differential  equations,  e.g.  fluid  flows.  It  can  also  be  used  to 
develop  reduced  order  control  models.  Fundamental  is  the  computation  of  POD  basis  functions  that  repre¬ 
sent  the  influence  of  the  control  action  on  the  system  in  order  to  get  a  suitable  control  model.  We  present  an 
approach  where  suitable  reduced  order  models  are  derived  successively  and  give  global  convergence  results. 

Key  words,  proper  orthogonal  decomposition,  Navier- Stokes,  flow  control,  reduced  order  modeling, 
trust  region 

Subject  classification.  Applied  Numerical  Mathematics 

1.  Introduction.  We  present  a  robust  reduced  order  method  for  the  control  of  complex  time-dependent 
physical  processes  governed  by  partial  differential  equations  (PDE).  Such  a  control  problem  often  is  hard 
to  solve  because  of  the  high  order  system  that  describes  the  state  (a  large  number  of  (finite  element)  basis 
elements  for  every  point  in  the  time  discretization).  The  proper  orthogonal  decomposition  (POD)  is  a  reduced 
order  modeling  approach  that  has  been  successfully  applied  for  the  simulation  and  control  of  complex  systems, 
see  e.g.  [1,  3,  4,  5,  6,  10,  11,  13].  POD  based  reduced  order  models  are  used  to  avoid  the  difficulty  of  dealing 
with  large  systems  by  using  global  basis  functions  instead  of  local  basis  functions  for  the  Galerkin  projection 
of  the  considered  PDE.  Often  a  small  number  of  these  global  basis  functions  suffices  to  obtain  a  satisfactory 
level  of  accuracy. 

However,  the  limited  number  of  degrees  of  freedom  in  the  reduced  order  POD  model  constitutes  its 
main  weakness  for  optimal  control  purposes.  Since  the  POD  model  is  based  on  the  solution  of  the  PDE 
for  a  specified  control,  it  might  be  a  poor  model  when  the  controller  takes  the  system  from  its  original 
state  towards  the  optimal  state.  There  is  no  guarantee  that  the  reduced  order  process  will  converge  to  the 
optimal  control  of  the  original  (large)  system.  This  difficulty  leads  us  to  propose  a  Trust-Region  Proper 
Orthogonal  Decomposition  (TRPOD)  method,  that  constructs  successively  improved  POD  models  based 
on  the  updated  control  values.  By  embedding  the  POD  technique  into  the  concept  of  trust-region  (TR) 
methods  with  general,  non-quadratic,  model  functions  and  inexact  gradient  information  [8,  16]  we  are  able 
to  prove  convergence  of  the  proposed  scheme.  That  approach  is  related  with  optimization  methods  that  use 
surrogate  objectives  [2,  7]. 

We  concentrate  on  the  application  of  TRPOD  for  flow  control  problems  with  Dirichlet  boundary  control 
governed  by  the  time-dependent  Navier- Stokes  equations  (NSE)  for  viscous  incompressible  fluids. 
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The  paper  is  organized  as  follows.  In  section  2  we  review  the  basic  ideas  of  the  POD  and  derive  a 
POD  based  control  model.  In  section  3  the  ideas  of  TRPOD  modeling  are  presented.  In  section  4  global 
convergence  of  the  TRPOD  scheme  is  treated.  In  section  5  several  numerical  examples  are  given.  In  section 
6  we  give  a  short  discussion  and  some  concluding  remarks. 

2.  Reduced  Order  Modeling  Using  Proper  Orthogonal  Decomposition  (POD).  The  starting 
point  for  POD  based  reduced  order  modeling,  for  flow  problems,  is  the  availability  of  an  input  collection  of 
flow  fields  yl(x)  =  y{x,ti)  (snapshots).  Given  the  snapshot  set 

(2.1)  ySNAP  _ 

the  POD  technique  can  be  used  to  identify  dominant  spatial  structures  in  the  flow.  For  ease  of  notation  we 
assume  that  the  snapshots  are  linearly  independent.  Then  the  POD  procedure  computes  an  orthonormal 
basis 


yPOD  =  {ip\...,4>N} 

for  the  subspace  spanned  by  ySNAP  and  determines  the  M  most  important  basis  elements  for  the  represen¬ 
tation  of  the  snapshot  set  in  the  above  orthonormal  basis. 

The  (accumulated)  error  of  this  optimal  truncated  basis  representation  is  given  by 

N  M  N  N 

(2.2)  ePOD(M)  =  ^2 II?/*  -  '^2(yi,ipj)ipi\\2  =  II  E 


i— 1 


3= 1 


i=l  j=M+ 1 


where 


N 


*'€-(1 . 

3— 1 

and  can  be  computed  explicitly  using  singular  value  analysis  [6,  10,  14].  By  the  choice  of  M  a  control  of  the 
magnitude  of  ePOD(M)  is  possible.  We  call  =  {ip1, . . . ,  ipM}  a  POD  basis  of  order  M. 

Expanding  the  velocity  field  in  terms  of  the  POD  basis, 

M 

V(x,t)  =  ^2aj(t)‘ip3(x), 
j~  1 

and  projecting  the  Navier-Stokes  equations  onto  the  subspace  spanned  by  the  POD  basis  yields  an  M- 
dimensional  ODE  system  for  the  expansion  coefficients: 

(2.3)  a(t)  =  F(a(t),t),  a(0)  =  a °. 

We  call  (2.3)  a  POD  model  of  order  M.  Combining  the  solution  of  (2.3)  and  the  expansion  (2.2)  results  in 
an  approximation  of  the  flow  dynamics. 

Let  us  suppose  that  the  snapshot  set  (2.1)  corresponds  to  a  flow  behavior  forced  by  a  certain  Dirichlet 
boundary  control  value,  so  we  can  replace  (2.3)  with  the  following  (cf.  [9,  13,  15]) 


(2.4) 


a(t)  =  F(a(t),u(t),t),  a(0)  =  a0. 


Here,  we  assumed  the  control  to  be  of  the  following  form  (u  denotes  the  Dirichlet  data  and  g  is  a  fixed 
function) : 

u(x,t)  —  u(t)g(x)  on  Tc. 


We  call  (2.4)  a  POD  based  control  model  of  order  M. 
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3.  The  Trust-Region  Proper  Orthogonal  Decomposition  (TRPOD)  Optimal  Control  Ap¬ 
proach.  In  the  following  we  consider  the  problem  of  minimizing 

(3.1)  f(n)  =  i  f  f  |j/(u)  -  yd |2  dx  dt 

1  Jo  J  Qob, 

where  y(x,t)  =  y(u;x,t)  is  the  solution  to  the  two  dimensional  Navier-Stokes  equations  for  prescribed 
Dirichlet  boundary  data,  u(x,t),  yd(x,t)  is  a  desired  state  and  Clobs  C  H  is  the  observation  volume  for  the 
observation  of  the  state  on  the  domain  H.  With  regard  to  the  POD  based  reduced  order  modeling  approach 
we  would  ideally  like  to  substitute  the  ‘full’  state  equations  with  a  POD  based  control  model  that  could  be 
used  for  the  optimal  control  process.  In  this  case  (3.1)  is  replaced  with 

(3-2)  fPOD(u )  =  \  [T  [  | yPOD(u)  -  yd |2  dx  dt 

lJ  0  J  noh, 

where  yPOD(u;x,t)  is  the  solution  of  the  POD  reduced  order  model  for  control  value  u(t)  (using  (2.4)  as  the 
POD  based  control  model). 

A  priori  it  is  not  clear  what  is  the  best  way  to  generate  snapshots  that  are  useful  for  the  POD  based 
control  procedure.  A  successful  POD  based  control  model  should  represent  correctly  the  dynamics  of  the  flow 
that  is  altered  by  the  controller.  It  is  therefore  natural  to  improve  the  POD  based  control  model  successively 
by  improving  the  snapshot  set  that  is  used  to  generate  the  POD  basis. 

First,  we  start  with  an  ‘arbitrary’  initial  control  uo(t)  and  compute  snapshots  that  correspond  to  the 
flow  behavior  forced  by  uG(t).  We  use  these  snapshots  to  compute  a  first  POD  basis  and  to  build  up  a 
corresponding  POD  based  control  model.  We  denote  the  optimal  control  based  on  by  Ui(t).  If  we  use 
ui  (t)  for  the  computation  of  a  new  snapshot  set  and  a  new  POD  basis  we  can  improve  the  initial  POD 
based  control  model.  The  new  basis  is  an  improvement  in  the  sense  that  the  minimization  of  the  objective 
function  based  on  results  in  an  ‘optimal’  control  U2{t)  such  that  /(u2)  <  f(ux).  The  solution  process 
for  the  reduced  order  control  problem  with  respect  to  this  second  POD  based  control  model  can  be  started 
with  the  last  control  function  iterate  ui(t). 

If  we  proceed  this  way,  i.e,  given  a  current  iterate,  uk(t),  for  the  control  we  compute  corresponding 
snapshots,  { y J, . . .  compute  a  POD  basis  build  a  current  POD  based  control  model  ( PCM )*. 

(3.3)  (PCM)k  a(t)  =  F(a(t),uk(t),t),  a{  0)  =  a0 

and  use  this  model  for  the  computation  of  the  next  iterate  Uk+i(t)  via  the  minimization  of  (3.2),  we  expect 
the  POD  model  to  converge  to  a  model  that  represents  the  flow  at  the  optimal  control  of  (3.1). 

In  order  to  guarantee  the  convergence  of  the  above  process  we  additionally  embed  it  in  a  trust  region 
framework. 

For  given  control  value  Uk  we  add  a  trust  region  constraint  to  the  unconstrained  optimization  problem 

(3.2)  and  minimize  with  respect  to  s 

(3.4)  fPOD(uk  4*  s)  —  ~  f  (  | yPOD(uk  +  s)  -  yd |2  dx  dt 

z  Jo  Jnoba 

subject  to 

(3.5)  \\s\\L2  <Sk. 
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Here,  yPOD(uk  +  s;x,t)  denotes  the  reduced  order  flow  solution  for  given  control  value  uk  +  s ,  where  the 
POD  based  control  model  is  generated  from  the  snapshots  related  to  uk.  Sk  denotes  the  trust  region  radius 
at  iteration  k. 

We  define  the  local  nonlinear  trust-region  model  for  the  original  objective  /  at  point  uk  by: 

(3-6)  rnk(uk  +  s)  fPOD(uk  +  s). 

We  denote  the  gradient  of  the  model  function  at  the  center  point  of  the  trust  region  by  gk  :=  Vmk(uk).  gk 
is  an  approximation  to  the  gradient  of  the  objective  function  f. 

The  outline  of  the  resulting  TRPOD  algorithm  is  given  below  (a  stopping  criterion  should  be  added  in 
practice) . 

Algorithm  1:  Outline  of  the  TRPOD  algorithm 

Let  w0,  Jo 5  0  <  Wi  <  V2  <  1  and  0  <  71  <  72  <  1  <  73  be  given,  set  k  =  0. 

1.  Compute  snapshot  set  y£NAP  corresponding  to  control  uk. 

2.  Compute  POD  basis  and  build  POD  based  control  model  (3.3). 

3.  Minimize  the  model  function  within  the  trust  region 


$k  =  arg  min  mk(uk  +  s) 


4.  Compute  f(uk  +  sk)  and  set  and 

pk  =  /(“*)  ~  f(Uk  +  Sk) 

mk(uk)  -mk(uk  +  sk) 

5.  Update  the  trust-region  radius: 

•  Pk  >  V2  :  set  uk+ 1  =  uk  +  sk  and  increase  trust  region  radius  Jjt+1  =  73Jfc,  set  k  =  k  +  1  and 
GOTO  1. 

•  If  Vi  <Pk  <  t)2  ■  set  uk+ 1  =  uk  4-  Sfc  and  decrease  trust  region  radius  Jfc+i  =  72  Jfc,  set  k  =  k  +  1  and 
GOTO  1. 

•  If  Pk  <  rji  :  set  uM  =  uk  and  decrease  trust  region  radius  5k+ 1  =  7xJfc,  set  k  =  +  1  and  GOTO  3. 
Following  [16]  we  call  an  iteration  successful  if  pk  >  771,  i.e.,  the  actual  reduction 

aredk(sk)  =  f(uk)  -  f(uk  +  sk) 
is  large  enough  compared  to  the  predicted  reduction 

predk(sk)  =  mk{uk)  -  mk(uk  +  sk). 

In  the  case  pk  <  ry  1,  we  call  the  iteration  unsuccessful. 
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For  a  practical  implementation  of  the  above  algorithm,  in  the  spirit  of  trust  region  methods,  two  specific 
modifications  should  be  considered. 

First,  in  the  case  of  a  rejection  of  the  new  trial  step  we  can  adapt  the  reduction  of  the  trust  region  radius 
to  the  step  length  of  the  unsuccessful  step,  in  order  to  avoid  a  possible  number  of  unnecessary  reductions 
that  show  no  effect  in  the  computation  of  a  new  descent  direction. 

Second,  it  is  not  necessary  to  compute  an  exact  (global)  minimum  in  step  3  of  Algorithm  1.  Instead,  we 
use  the  following  step  determination  algorithm  for  the  computation  of  a  descent  direction  [16]. 


Algorithm  2:  Step  determination  algorithm 


Let 

(3.7) 

be  given. 


0  <  a  <  0  <  1,  0  <  vi  <  1,  i/2  >  0,  vz  >  0,  0  <  <  1 


Phase  1:  Find  Af  such  that 

(3.8) 


mk(uk  -  A kgk)  <  mk(uk)  -  a\k\\gk\\2 

11^*11  <4 


A*  >  Af  or  Afc  >  minimi  ^2} 


(3.9) 
and 

(3.10) 

where  Af  >  0  (if  required)  must  satisfy 

(3.11)  mk(uk  -  A kgk)  >  mk(uk)  -  f3\k\\gk\\2 
Phase  2:  If  Sk  >  ^3:  Choose  step  $k  such  that 

(3.12)  mk{uk)  -  mk(uk  +  sk)  >  g. ( mk(uk )  - mk{uk  -  Xkgk)) 


(3.13)  \\sk\\  <  4 

In  Phase  1  of  Algorithm  2  we  compute  a  step  in  the  steepest  descent  direction  that  guarantees  a  sufficient 
decrease  in  the  model  function.  We  also  ensure  that  the  step  stays  within  the  trust  region  and  that  the  step 
size  is  not  too  small.  This  means  that  Phase  1  can  be  interpreted  as  a  substitute  for  the  computation  of 
the  Cauchy  point  in  standard  trust  region  methods  for  unconstrained  optimization  (UTR).  Phase  2  allows 
to  leave  the  steepest  descent  direction  if  the  trust  region  is  sufficiently  large.  Similar  to  dogleg  methods 
for  the  approximation  of  Sk  =  argminjjsij^^  +  s)  in  the  quadratic  model  function  case  by  using  a 

descent  direction  that  includes  a  certain  part  of  the  step  into  the  steepest  descent  direction  and  the  (Quasi-) 
Newton  direction,  the  above  algorithm  first  guarantees  a  sufficient  decrease  in  the  model  function  by  using 
the  steepest  descent  direction  (Phase  1)  and  then  it  allows  an  optional  modification  of  the  step  direction  in 
Phase  2.  For  Algorithm  2  the  following  result  holds  whose  proof  can  be  found  in  [16]. 

Lemma  3.1  (Toint  ’88).  Provided  that  (3.7)  holds ,  there  always  exists  a  step  Sk  satisfying  the  conditions 
(3.8)  -  (3.13). 
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4.  Convergence  Results.  In  the  context  of  trust  region  methods  we  can  interpret  the  TRPOD  ap¬ 
proach  for  the  optimal  flow  control  problem  as  a  trust  region  method  with  a  non-quadratic  model  function 
[16]- 

For  this  purpose  we  consider  a  discretization  of  (3.1),  (3.6)  such  that  f,mk  :  IRn  -4  JR.  For  a  given  uq 
in  the  control  space  U ,  let  Uq  be  an  open  convex  subset  containing  the  level  set  Cq  defined  by: 

C0  =  {u  6  Wj  f{u)  <  /(m0)}  CW0CW. 

We  assume  that  /  satisfies  the  following  standard  assumptions: 

•  /  is  continuously  differentiable  on  Uq  , 

•  /  is  bounded  below  on  Uq , 

•  V/  is  Lipschitz  continuous  with  constant  L  on  Uq. 

We  emphasize  the  fact  that  unlike  common  quadratic  trust  region  model  functions  mk{uk  +  s )  is  not 
quadratic  in  s.  Furthermore,  for  the  model  function  mk  based  on  POD  we  have 

(4.1)  mk(uk)  ^  f{uk) 

and 


(4.2) 


9k  =  Vmk{uk)  #  V/(Mfc), 


i.e.,  both  the  model  function  value  at  the  trust  region’s  center  point  and  the  gradient  of  the  POD  derived 
model  function  are  inexact.  We  assume  the  models  mk  to  satisfy  the  following  properties  [8,  16]: 

•  each  mk  is  differentiable 

•  there  exists  a  positive  integer,  iV,  such  that  the  gradient  of  each  model,  gk,  satisfies  the  following 
inequality  for  k  >  N, 


(4-3) 


l(g*  ~  V/K-))TSfcl  <  * 

MINI 


for  some  user-specified  constant  £  >  0,  where  sk  is  the  step  according  to  Alg.  2. 

Condition  (4.3)  requires  that  the  normalized  reduced  order  directional  derivative  in  descent  direction  ap¬ 
proximates  the  normalized  full  directional  derivative  sufficiently  well  in  the  limit. 

Based  on  the  above  assumptions  we  prove  the  convergence  of  the  TRPOD  scheme  using  techniques 
similar  to  the  standard  trust  region  method  for  unconstrained  optimization.  Specifically,  we  use  results  of 
Toint  [16]  concerning  trust  region  algorithms  with  non-quadratic  model  functions,  and  Carter  [8]  who  also 
treated  trust  region  algorithms  with  inexact  gradient  information. 

For  convergence  proofs  of  standard  trust  region  methods  with  inexact  gradients  an  essential  condition 
is  the  sufficient  decrease  condition 

(4-4)  f{uk)  -  f(uk  +  sk)  >  ^c||pfc||min{4,||^l} 


for  some  c> 0  and  where  \\Hk\\  denotes  the  norm  of  the  Hessian  of  the  model  function. 

In  the  general  nonlinear  model  function  case  we  have  to  derive  an  analogous  sufficient  decrease  condition 
by  other  means.  We  define  the  following  estimate  of  a  function’s  curvature  along  the  step  s  based  at  a  point 
u  [16]: 


(4-5) 


u(f,u,s)  pjp(/(M  +  s)  -f{u)  -  V/(m)ts). 
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The  following  theorem  gives  a  lower  bound  to  the  predicted  decrease  in  the  model  function  [16]. 
Theorem  4.1  (Toint  ’88).  Assume  that  He/* II  ^  0  and  define  according  to  Algorithm  2 


(4.6) 

Then 


:= 


0  when  Af  is  undefined 

w{mk,Uk,  —  Afpfc)  when  Af  is  defined 


>  0 

and  there  exists  a  constant  cs  >  0  such  that  Algorithm  2  produces  a  step  s*  with 
(4.7)  mk(uk)  -  mk(uk  +  sk)  >  cs||pfc||2  min{||p* ||2/(1  +w*),<5*}. 


As  an  immediate  corollary  we  get  the  following  result,  analogous  to  the  sufficient  decrease  condition 
(4.4),  that  describes  the  decrease  in  the  objective  when  the  iteration  is  successful  [16]. 

Corollary  4.2.  Let  the  assumptions  of  Theorem  4-1  be  satisfied  and  assume  that  the  k-th  iteration 
was  successful  Then 

f(uk)-f(u Jfe+i)  >  J?iCi||pj;||2  min{||<7fc||2/(l  +  u>k),5k}. 

The  next  lemma  is  required  in  the  global  convergence  proof  (cf.  [8]).  Its  proof  follows  from  the  definition 


of  Algorithm  2. 

Lemma  4.3.  Let  {$*}  be  a  sequence  of  steps  computed  by  Algorithm  2  and  {gk}  the  sequence  of  the 
model  gradients.  We  define 


(4.8) 


cos©* 


Z£k9k 

INI  INI' 


If  liminffc_+00  ||p*|l  >  0  and  lim*-^  5k  =  0  then 


(4.9) 


lim  cos©*  =  1. 

k~¥oo 


We  now  give  the  main  convergence  theorem  for  the  TRPOD  method. 

Theorem  4.4.  Let  f  satisfy  the  standard  assumptions .  Assume  that  {uk}  is  a  sequence  of  iterates 
generated  by  Algorithm  1  with  step  determination  according  to  Algorithm  2  and  that  there  exists  a  positive 
integer ,  N,  such  that 

(410)  ’crd,k>N 
for  some  £  with  0  <  £  <  1  —  772  •  We  define 

(4.11)  bk  :=  1  4-  max{max{tJi,  | Si)|},2  =  0, . . . ,  k) 
and  assume  that  there  exists  some  constant  c&  >  0  such  that 

(4.12)  bk  <  cb  for  all  k>  N. 
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Then 


liminf  Hflfell  =  0. 

K-*  OO 


lim inf  ||</*||  >  £ 

k->  OO 


Proof:  The  proof  follows  by  contradiction.  We  assume  that 

(4.13) 

for  some  e  >  0.  Using  Corollary  4.2  we  get 

OO 

(4.14)  £>< 

k—0 


OO 


using  standard  arguments  [8].  For  k  sufficiently  large  with  (4.5)  and  (4.8)  we  have 
mk{uk  +  sk)  -  mk(uk)  -  (f(uk  +  sk)  -  f(uk)) 


1  ~  Pk  = 


mk(uk  +  sk)  —  mk(uk) 

_  §||sfc||Mmjt,ttfc,Sfc)  +g^Sfc  -  (|||sfc||2tj(/,Mfc,Sfc)  +  V/(«fc)TSfc) 

l\\sk\\2w{mk,uk,sk)  +  g%sk 

\(Vf(uk)-gk)Tsk\  +  g|i3fc|[2|qj(/, afc)  -u(mk,uk,sk)\ 


< 


(4.15) 


-9ksk  -  §||s*||M"I*>'u/:>sfc) 

l(V/(«*)  ~  9kfsk\  +  |||sfe|l2(|a;(/,Mfc,sfc)|  +  |oj(rrzfe ,  sfc)|) 
llfffcll  llsifell  cos ©*  -  !l|sfc||2w(mfc,Ufc,Sjfc) 


COS0fc  2  y  &k) 

The  Lipschitz  continuity  of  V/  leads  to 

(4.16)  u(f,uk,sk)  <  L 

where  L  is  the  Lipschitz  constant  of  V/.  Combining  (4.16),  (4.11)  and  ||$jt||  <  Sk  yields 


l(V/(ttfc)"gfc)TSfel  ,  1  llsfcll 
*  o 


(4.17) 


1  -Pk< 


ra  im 


2  llpfcl 


(L  +  bk) 


cos  &k  -  |  UfrHW(m*>  uk,Sk) 

Now  we  can  use  (4.9),  (4. 10), (4. 11),  (4.12),  (4.13)  and  Sk  ->  0  to  deduce  that 


(4.18) 


lim  (1  -  pk)  <  C  <  1  -V2- 

k—too 


The  above  limit  implies  that  there  exists  k  with  pk  >  77 2  for  all  k  >  k  such  that  the  trust  region  radius  Sk  is 
not  reduced  for  all  k  >  k,  leading  to  a  contradiction  with  Sk  -¥  0  for  k  ->*  00.  □ 


Remark:  Since  w{mk,  uk,  sk)  is  a  measure  for  the  model’s  curvature  in  step  direction,  assumption  (4.12) 
is  an  analogue  to  the  standard  assumption  of  uniformly  boundedness  of  the  models  Hessian  in  the  quadratic 
model  function  case  (cf.  [12]). 
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Table  5.1 

TRPOD  Parameters 


TR  Framework  Step  Determination 


vu  m 

0.25,  0.75 

a,  p 

0.25, 

0.75 

7i,  72,  73 

0.5,  0.5,  2 

*7,  ^2,  ^3,  P 

0.1, 

0.1,  0.1  ,  1 

5.  Numerical  Results.  In  this  section  we  present  numerical  studies  of  the  TRPOD  based  control 
method  applied  to  the  standard  driven  cavity  test  case.  All  flow  calculations  were  carried  out  with  the  flow 
solver  FEATFLOW  [17]  at  Reynolds  number  Re  =  200,  on  the  time  interval  [0, 5],  using  a  uniform  grid.  The 
parameters  for  the  TRPOD  algorithm  are  given  in  Table  5.1. 

Two  examples  are  in  order.  In  the  first  example  we  choose  a  small  observation  domain  (1.44%  of  0.) 
and  a  small  control  space  (7  control  variables).  In  that  example  the  problem  is  small  enough  so  that  the 
assumptions  of  Theorem  4.4  can  be  verified  explicitely.  In  the  second  example  we  choose  the  entire  cavity 
to  be  the  observation  domain  and  the  control  space  is  of  maximum  dimension  (167  control  variables).  The 
purpose  of  this  example  to  illustrate  the  significant  change  in  the  POD  basis  due  to  the  changes  in  the 
control  input,  and  to  demonstrate  the  effectiveness  of  the  TRPOD  method  for  larger  scale  problems.  In  that 
example  we  did  not  verify  the  assumptions  of  Theorem  4.4  due  to  the  large  number  of  control  variables. 


Example  1.  In  the  first  example  the  control  of  the  cavity  flow  is  the  top  wall  velocity  (and  there 
is  no  control  action  on  the  bottom  wall,  i.e.,  yl  —  y2  =  0  on  T^).  We  reduce  the  number  of  control 
variables  by  restricting  the  control  space  using  the  expansion  «(t)  =  J2k=iuktPk{t)  with  <pi(t)  =  1  and 
<P2k(t)  =  cos(2knt/T),  (fi2k+i(t)  =  sm(2knt/T),  k  =  1, 2, . . . ,  7,  (R  =  7). 

For  this  example,  the  desired  state  yd  corresponds  to 


ud  =  (0.8, 0.1,  -0.3, 0, 0.1,  -0.3, 0). 


Furthermore,  we  chose  €lobs  =  [0.44,  0.56]  x  [0.44,  0.56]  in  the  center  of  the  domain  fi  =  [0,  1]  x  [0,  1]  and 
initialized  the  TRPOD  algorithm  with  u0(t)  =  0.01  and  <50  =  0.25. 

Table  5.2  lists  the  values  of  the  objective  function,  f{uk),  and  the  model  function  at  the  beginning  of 
each  iteration  k,  m(uk).  The  trust  region  radius,  Si; ,  the  computed  step  length,  ||s*||,  the  quotient  of  achieved 
reduction  to  the  predicted  reduction,  pk ,  and  the  number  of  POD  basis  elements,  A7,  at  the  beginning  of 
each  TRPOD  iteration.  Furthermore,  for  this  example  we  checked  if  the  gradient  error  condition  (4.10) 


(5.1) 


...  |(g*-V/(ttfc))Tgfc| 

INI  INI 


<  1  -  >72 


is  satisfied.  The  values  of  are  also  shown  in  Tab.  5.2  so  that  we  can  realize  that  (k  <  0.25  holds  for  k  >  1. 
Based  on  the  values  of  sk,  mk(uk),  mk(uk  +  sk)  and  gk  we  found  that  (4.12)  is  satisfied  with  bk  <  cb  =  2. 
We  stopped  the  TRPOD  algorithm  after  four  iterations  where  the  objective  function  value  is  reduced  from 
f{u0)  =  5.99e  — 4  to  /(u5)  =  4.67e-7. 

In  Fig.  6.1  the  control  iterates  are  shown  and  compared  to  ud.  Fig.  6.2  depicts  ud,  u4,  and  the  solution 
of  the  reduced  order  control  problem  (without  TRPOD),  u0pi.  Figs.  6.3  and  6.4  illustrate  the  improvements 
in  the  objective  function  for  this  example. 

Example  2.  We  consider  the  boundary  control  of  a  cavity  flow  where  a  vortex  evolves  resulting  from  the 
movement  of  the  top  wall  of  the  cavity  at  a  constant  horizontal  velocity.  The  control  action  is  a  horizontal 
movement  of  the  bottom  wall  of  the  cavity  such  that  a  second  vortex  evolves  that  counteracts  the  first  vortex 
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Table  5.2 

TRPOD-Results  (Example  1) 


0 

HI 

□ 

5.99658e-4 

5.960310e-4 

0.25 

0.25 

1.58 

m 

m 

Jl 

3.16328e-4 

3.195711e-4 

0.5 

0.46 

1.51 

EH 

m 

□ 

1 

0.81 

0.1183 

4 

3 

4 

| 

(see  Fig.  6.5).  Thus,  the  control  variable,  u(t),  is  the  time-dependent  magnitude  of  this  horizontal  boundary 
velocity.  The  desired  state,  yd ,  corresponds  to  a  predefined  time-dependent  bottom  wall  velocity,  ud ,  such 
that  we  are  able  to  compare  the  computed  optimal  control  to  the  exact  solution.  Due  to  a  time  discretization 
of  A t  =  0.03  we  get  n  —  167  control  variables,  i.e.,  the  control  space  is  of  maximum  dimension.  We  choose 
the  observation  domain  to  be  the  entire  cavity,  fto6s  =  ft,  and  initialize  the  TRPOD  algorithm  with  initial 
control  of  'Uo(^)  =  0.1  (constant  over  time)  and  initial  TR  radius  of  So  =  2. 

Table  5.3  lists  the  values  of  the  objective  function,  /(u* ),  and  the  model  function  at  the  beginning  of 
each  iteration  k ,  ra(it*),  the  trust  region  radius,  6k)  the  computed  step  length,  ||s*||,  the  quotient  of  achieved 
reduction  to  the  predicted  reduction,  p* ,  and  the  number  of  POD  basis  elements,  M,  at  the  beginning  of 
each  TRPOD  iteration. 

In  the  beginning  of  the  iterative  process,  the  trust  region  constraint  is  active  for  the  computed  steps, 
and  the  quotient,  p*,  indicates  that  the  trust  region  radius  should  be  further  increased,  keeping  the  same 
model,  m(uk).  However,  in  the  TRPOD  method,  the  state  y(uk  +  s*)  is  computed  in  the  evaluation  of  the 
quotient,  p*,  thus  we  can  use  this  new  information  to  update  the  model  (instead  of  keeping  the  previous 
model).  We  stop  the  TRPOD  algorithm  after  5  iterations,  where  the  objective  function  value  is  reduced 
from  f(uQ)  =  0.229239  to  /(u5)  =  0.000132. 


Table  5.3 

TRPOD-Results  (Example  2) 


k 

/(«*) 

mk{uk) 

4 

Nib 

Pk 

M 

0 

0.229239 

0.118274 

2 

2.00 

2.36 

5 

1 

0.149097 

0.148143 

4 

4.00 

1.27 

5 

2 

0.080427 

0.080532 

8 

6.84 

1.47 

5 

~3~ 

0.006864 

0.008835 

16 

2.87 

0.93 

6 

T~ 

0.000246 

0.000795 

32 

0.29 

3.61 

8 

5 

0.000132 

Fig.  6.6  depicts  the  control  iterates,  it*,  and  compared  to  the  desired  optimal  control,  ud.  Fig.  6.7 
depicts  ud,  1/5,  and  the  solution  of  the  reduced  order  control  problem  without  TR  modifications,  uopt.  In  the 
case  without  TRPOD  we  used  a  single  POD  based  control  model,  corresponding  to  the  initial  control  uq, 
without  imposing  a  TR  constraint.  Figs.  6.8  and  6.9  illustrate  the  improvements  in  the  objective  function. 

Fig.  6.10  depicts  vector  plots  of  the  first  four  POD  basis  functions  corresponding  to  the  initial  control, 
and  Fig.  6.11  depicts  similar  plots  corresponding  to  the  computed  optimal  control.  These  figures  illustrate 
the  significant  change  in  the  POD  basis  due  to  the  changes  in  the  control  input. 
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6.  Discussion  and  Concluding  Remarks.  We  present  a  robust,  globally  convergent,  approach  to 
optimal  control  based  on  POD  modeling.  This  approach  can  be  interpreted  in  the  context  of  trust  region 
methods  using  general  nonlinear  model  functions  with  inexact  gradient  information.  Convergence  results 
for  this  class  of  trust  region  methods  carry  over  to  the  TRPOD  method.  Numerical  experiments  indicate 
the  effectiveness  of  this  approach.  Optimization  without  POD  reduced  order  models  requires  the  solution 
of  the  full  state  equation  and  full  sensitivity  (or  adjoint)  equations  for  each  ‘value’  of  the  control  during  the 
optimization  process.  Using  POD  based  control  models  we  only  have  to  solve  the  full  state  equation  if  we 
intend  to  build  a  new  model.  Then  we  can  perform  a  sequence  of  optimization  steps  using  reduced  order 
gradient  information  until  we  have  to  update  the  model.  This  amounts  in  saving  a  lot  of  computational 
work  if  the  solution  of  the  full  state  equation  (and  full  sensitivity  or  adjoint  equations)  is  computationally 
expensive. 

The  numerical  results  also  demonstrate  that  the  use  of  POD  for  reduced  order  optimal  control,  based 
on  control  input  that  is  far  from  the  solution,  may  lead  to  a  large  error  in  the  approximated  solution. 

Unlike  the  traditional  TR  theory  (see  e.g.  [2,  16]),  we  have  rrik(uk)  ^  /(«*).  Still,  we  do  not  need  to 
change  most  of  the  conventional  TR  convergence  theory,  since  the  quality  of  the  approximation  of  f(uk) 
by  mfc(wfc)  does  not  enter  into  the  proofs  directly.  However,  we  have  to  guarantee  through  condition  (4.10) 
that  the  gradient  of  the  model  function,  Vmjt,  approximates  the  gradient  of  the  ‘full’  objective  function, 
V/,  sufficiently  well.  In  general  we  do  not  expect  the  model  gradient,  Vm^,  to  be  a  good  approximation  of 
the  gradient,  V/,  unless  sensitivity  (or  adjoint)  information  of  the  ‘full’  problem  is  taken  into  account.  In 
this  context,  it  is  still  not  clear,  e.g.,  how  to  incorporate  snapshots  of  the  sensitivities  into  the  POD  model 
without  compromising  the  quality  of  the  state  approximation. 
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